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Markov and Chebyshev Inequalities 


6.2.2 Markov and Chebyshev Inequalities 

Let X be any positive continuous random variable, we can write 
EX = J^ oo xfx(x)dx 

= / 0 °° xfx(x)dx (since X is positive-valued) 

> J a °° xfx(x)dx (for any a > 0) 

> J a °° afx(x)dx (since x > a in the integrated region) 

= a f a °° fx{ x ) dx 

= aP(X > a). 

Thus, we conclude 

EX 

P(X > a) < -, for any a > 0. 

a 


We can prove the above inequality for discrete or mixed random variables similarly (using the 
generalized PDF), so we have the following result, called Markov's inequality. 



Example 6,19 

Prove the union bound using Markov's inequality. 

• Solution 

o Similar to the discussion in the previous section, let Ai , A 2 , . . . , A n be any 
events and X be the number events Ai that occur. We saw that 
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EX = P(Ai) + P(A 2 )+. ■ ■ +P(A„) = 

i—1 

Since X is a nonnegative random variable, we can apply Markov's inequality. 
Choosing a — 1, we have 

n 

P(X > 1 )< EX = 

i= 1 

But note that P(X > 1) = P t A{ 



Example 6.20 

Let X ~ Binomial (fl, P ). Using Markov's inequality, find an upper bound on 
P[X > cm), where P < Ct < 1 . Evaluate the bound for p = j and Ct = 

• Solution 

o Note that X is a nonnegative random variable and EX — up. Applying 
Markov's inequality, we obtain 


P(X > an) < 


EX pn p 


an an a 


1 3 

For p — — andct = -j, we obtain 


_ _ 3 n. 2 

PA > T ) < 3 ■ 


Chebyshev's Inequality: 

Let X be any random variable. If you define Y — ( X — EX)^ , then Y is a nonnegative 
random variable, so we can apply Markov's inequality to Y. In particular, for any positive real 
number b, we have 


P(Y > b 2 ) < 


EY 
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But note that 

EY = E(X - EX) 2 = Var(X), 

P{Y > b 2 ) = P((X- EX) 2 > b 2 ) = P(\X - EX | > b). 

Thus, we conclude that 

P(\X-EX\>b)< VaT ) X) . 


This is Chebyshev's inequality. 



Chebyshev's inequality states that the difference between X and EX is somehow limited by 
Var(X) . This is intuitively expected as variance shows on average how far we are from the 
mean. 

Example 6.21 

Let X ~ Binomial (n, p). Using Chebyshev's inequality, find an upper bound on 
P(X > cm), where p < Ct < 1 . Evaluate the bound for p = j and On — j . 

• Solution 

o One way to obtain a bound is to write 

P(X > an) = P(X — np > an — np) 

< P(\X — np | > na — np) 

Var(X) 

( na—np ) 2 

P(l-P) 

n(a—p) 2 
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For p — — and Oi. — 


, we obtain 


p(x > ^) < -. 


<— previous 
next —» 
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